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Assessing  Technological  Progress  Using  Hazard 
Rate  Models  of  R&D  Communities* 


Michael  A.  Rappa 

Massachusetts  Institute  of  Technolo^ 

Abstract 

This  paper  describes  the  use  of  hazard  rate  models  for  assessing  emerging  technologies.  It  suggests  that  on  a 
global  scaJe  the  decisions  of  researchers,  in  terms  of  their  entrance,  continuance,  and  exit  from  a  field,  can 
serve  as  an  indicator  of  the  rate  of  progress  in  the  emergence  of  a  new  technology.  The  approach  is  demon- 
strated using  the  literature  on  magnetic  bubble  memory  technology  as  a  source  of  data  to  determine  the 
contribution-spans  of  researchers.  Survival  and  hazard  functions  are  estimated  based  upon  the  experience  of 
more  than  seventeen-hundred  researchers  contributing  to  the  held  over  two  decades. 

1.  Introduction 

In  the  highly  competitive  battleground  of  memory  technology,  the  battlefield  is  strewn  with 
the  relics  of  concepts  and  devices  whose  promises  were  never  fulfilled  or  have  failed  to  meet 
the  ultimate  test  of  time  (Bobeck,  Bonyhard  and  Geusic,  1975). 

Around  the  world,  each  and  every  day,  scientists,  engineers,  and  managers  make  choices 
about  the  direction  to  employ  their  time  and  resources  in  developing  newly  emerging  tech- 
nologies. These  are  undoubtedly  difficult  judgments  to  make.  Although  the  alternatives 
confronting  them  may  be  evident,  the  appropriate  direction  to  pursue  is  seldom  absolutely 
clear.  Any  choice  is  likely  to  be  contingent  on  a  number  of  factors  that  may  vary  in  their 
clarity  and  significance  over  time.  In  pursuing  the  development  of  a  technology,  managers 
must  be  confident  in  their  answers  to  several  questions,  such  as:  Will  researchers  adequately 
resolve  the  technical  problems?  Will  the  development  of  an  alternative  technology  prema- 
turely diminish  its  usefulness?  Will  a  sufficiently  large  market  come  about  to  make  the  cost 
of  developing  the  technology  worth  the  time  and  effort?  How  will  competitors,  suppliers, 
and  customers  react?  Finding  the  answers  to  such  questions  is  a  major  preoccupation  for 
management. 

The  factors  that  may  influence  the  rate  of  a  technology's  development  would  appear  to 
be  many  and  diverse.  New  technologies  emerge  within  a  complex  socio-technical  system 
that  typically  includes  the  interaction  of  many  individuals  and  organizations,  each  making 
their  own  decisions  about  what  to  do — or  not  to  do — and  when  (Rappa  and  Debackere, 
1992;  Van  de  Ven,  1993).  Any  single  actor  (individual  or  organization)  alone  may  have 
relatively  little  effect  on  the  overall  process  of  emergence.  Moreover,  factors  that  appear  to 
have  a  major  influence  may  have  far  less  actual  significance,  while  factors  that  appear  to 
have  minor  consequences,  or  go  relatively  unnoticed,  may  have  a  major  effect.  Indeed,  there 
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may  be  so  many  factors  involved  that  the  influence  of  any  single  one,  when  considered 
independently,  may  be  highly  misleading. 

In  the  face  of  such  complexity,  any  effort  to  determine  and  predict  the  factors  that  affect 
the  rate  of  a  technology's  emergence  may  very  well  be  misplaced.  What  is  certain  is  that  a 
new  technology  emerges  through  the  sustained  efforts  of  researchers  who  seek  the  solutions 
that  make  it  viable.  The  decisions  of  these  researchers  as  a  whole — in  terms  of  their 
entrance,  continuance,  and  exit  from  a  particular  technological  field — may  provide  some 
indication  of  their  perceptions  of  the  rate  of  progress.  Thiis,  rather  than  search  for  specific 
factors  affecting  the  rate  of  a  technology's  emergence  and  to  decipher  their  impact,  a  differ- 
ent approach  would  be  to  ascertain  the  likelihood  of  persistence  among  researchers  working 
in  the  field. 

Within  the  domain  of  their  education  and  training,  researchers  normally  have  some 
degree  of  latitude  in  applying  their  skills,  and  are  likely  to  pursue  the  direction  they  consider 
to  hold  the  most  promise.  Researchers  are  likely  to  shift  their  focus  among  different 
technologies  in  accordance  with  their  perceptions — as  well  as  those  of  their  colleagues  and 
managers — of  the  likelihood  of  success  and  the  potential  payoff.  While  pursuing  an  agenda, 
researchers  must  periodically  reassess  their  commitments  based  upon  their  sense  of  how  well 
the  work  is  proceeding.  If  the  pace  of  progress  is  reasonably  well,  they  may  be  more  inclined 
to  stick  with  it.  However,  if  progress  is  slower  than  they  had  anticipated,  they  must  decide 
to  redouble  their  efforts  or  ultimately  to  move  in  a  different  direction. 

It  is  precisely  in  this  manner  that  the  decisions  of  researchers  as  a  whole  may  signal 
changes  in  a  technology's  rate  of  progress  toward  commercialization.  The  aggregate  measure 
of  such  decisions  may  very  well  embody  all  of  the  information  available  about  the  likelihood 
of  successfully  developing  a  technology.  That  is,  it  may  represent  the  cumulative  judgments 
of  all  of  those  who  work  in  the  field  and  who,  through  their  decisions  to  stay  with  or  dis- 
continue their  activities  are  signaling  their  own  assessment  of  a  technology.  The  basic 
assumption  is  that  there  is  a  correspondence  between  the  rate  of  progress  in  a  technical  field 
and  the  likelihood  of  researchers  continuing  in  it. 

2.  Hazard  Rate  Models  of  Emerging  Technologies 

Given  the  duration  of  activity  for  individual  researchers  in  a  field,  it  is  possible  to  esti- 
mate for  this  population  (I)  the  probability  that  a  researcher  will  continue  in  a  field  a  given 
number  of  years,  and  (2)  the  probability  that,  having  been  in  the  field  a  given  number  of 
years,  a  researcher  will  exit  the  field.  In  actuarial  statistics,  these  are  known  as  the  survival 
and  hazard  functions  of  a  population  (Lee,  1992).  The  same  statistics  are  used  in  sociology 
(Allison,  1984;  Yamaguchi,  1992),  economics  (Lancaster,  1990),  and  organizational  ecology 
(Hannan  and  Freeman,  1989).  The  method  was  developed  in  order  to  take  into  account  the 
indeterminacy  of  duration  for  a  segment  of  the  population  which  remains  active  at  the  time 
of  analysis  by  censoring  such  cases  (see  the  appendix  for  the  formal  derivation  of  the  survival 
and  hazard  functions). 

It  is  posited  that  shifts  in  the  survival  and  hazard  functions  over  time  may  serve  as  an 
indicator  of  changes  in  confidence  among  researchers  in  a  field.  The  survival  curve,  illus- 
trated in  Figure  2.1,  indicates  the  cumulative  probability  of  remaining  in  the  field  n  years. 
The  implications  of  a  downward  shift  in  the  survival  function  from  time  period  t  x.o  t+\, 
shown  in  diagram  (a),  suggests  that  the  probability  of  remaining  in  the  field  n  years  has  de- 
creased over  time.  In  the  case  of  «=5  years,  the  survival  rate  declines  from  s^  to  s^^y  In 
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Figure  2. 1 :  Survival  rate  comparison  from  one  period  to  the  next. 


diagram  (b)  the  opposite  outcome  is  shown,  in  which  the  survival  function  shifts  upward 
from  one  time  period  to  the  next.  This  suggests  an  increase  in  the  likelihood  of  remaining  in 
the  field  n  years. 

Although  the  survival  function  may  provide  a  useful  understanding  of  the  likelihood  of 
continuance  in  a  field,  the  hazard  fijnction  can  be  more  informative.  It  suggests  the  condi- 
tional probability  of  exit  from  the  field,  given  a  researcher  has  been  in  the  field  n  years.  An 
increase  in  the  hazard  rate  may  signal  a  lack  of  progress  in  the  field,  while  a  reduction  in  the 
hazard  rate  may  suggest  that  researchers  are  confident  in  the  present  rate  of  progress. 

The  hazard  curve  dynamics  are  illustrated  in  Figure  2.2.  In  diagram  (a),  the  hazard 
curve  shifts  downward  from  time  period  ^  to  ^+1.  This  suggests  that  the  probability  of  a  re- 
searcher leaving  the  field  after  one  year  declines  from  A,  to  At  ^"'1  ^^"^  probability  of  leaving 
the  field  after  having  been  in  it  for  five  years  declines  from  h-^  to  A4.  In  diagram  (b)  the  op- 
posite result  is  demonstrated,  in  which  the  hazard  curve  shifts  upward  from  one  period  to 
the  next.  This  suggests  an  increase  in  the  probability  of  a  researcher  exiting  after  one  year  in 
the  field  from  A,  to  Ai.  ^"'l  ^'^  increase  in  the  probability  of  exiting  the  field  after  having 
been  in  it  for  five  years  from  h-^  to  ^4. 

Notice  that  the  hazard  rate  is  higher  and  changes  more  substantially  for  researchers  who 
are  in  the  field  only  a  short  time.  This  implies  that  as  researchers  accumulate  intellectual 
capital  in  a  field  they  become  less  and  less  likely  relinquish  this  investment  by  switching  to 
other  fields.  This  is  consistent  with  empirical  studies  of  other  fields  (e.g.,  Rappa  and  Garud, 
1992)  that  show  that  the  longer  a  researcher  is  in  a  field  the  less  likely  that  he  or  she  is  to 
leave  it.  Thus,  we  should  expect  a  higher  and  more  volatile  hazard  rate  for  researchers  with 
less  time  in  the  field. 

Another  way  to  view  the  change  over  time  in  the  hazard  rate  is  to  plot  the  rate  for 
researchers  with  a  given  duration  (d)  in  the  field  for  each  year.  The  hazard  rate  for  d=\  is 
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Figure  2.2:  Hazard  rate  comparison  from  one  period  to  the  next. 

interesting  because  it  indicates  the  probability  of  sticking  with  it  among  researchers  who  are 
new  to  the  field.  However,  it  might  also  be  interesting  to  see  how  much  the  hazard  rate 
changes  for  researchers  who  have  been  in  the  field  somewhat  longer  (e.g.,  d='b).  This  form  of 
analysis  is  illustrated  in  Figure  2.3.  In  diagram  (a)  the  hazard  rate  is  generally  decreasing 
from  year-to-year.  This  implies  that,  over  time,  researchers  who  have  been  in  the  field  for 
both  one-year  and  five-years  are  increasingly  more  likely  to  remain  in  the  field.  In  diagram 
(b)  the  hazard  rate  is  increasing  from  year-to-year  for  researchers  in  both  categories,  imply- 
ing that  over  time  researchers  in  both  cases  are  increasingly  more  likely  to  leave  the  field. 
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Figure  2.3:  Change  over  time  in  the  hazard  rate  for  researchers  with  one-year  and  five-year 
durations 


Assessing  Tfchrwtogicai  Progrtss  5 

3.  The  Case  of  Magnetic  Bubble  Technology 

The  historical  development  of  magnetic  bubble  memory  technology  serves  to  illustrate 
the  use  of  hazard  rate  analysis  for  the  purpose  of  technology  assessment.  Magnetic  bubbles 
are  a  solid-state  integrated  circuit  technology  similar  to  that  of  metal-oxide  semiconductors 
in  that  they  are  fabricated  in  a  thin  epitaxial  layer  grown  on  a  wafer  substrate.  The  devices 
store  data  in  the  form  of  "bubbles"  moving  in  a  thin  film  of  magnetic  material.  The  bubbles 
are  cylindrical  magnetic  domains  whose  polarization  is  opposite  to  that  of  the  magnetic  film 
in  which  they  are  embedded.  Bobeck  and  Scovil  (1971)  found  the  bubbles  to  be  stable 
across  a  wide  range  of  conditions  and  movable  from  point-to-point  at  high  speed. 

The  initial  patents  for  a  magnetic  bubble  memory  device  were  filed  by  Bell  Laboratories 
between  May  and  September,  1966.  Evidence  that  interest  in  the  new  technology  grew 
rapidly  can  be  seen  in  the  flurry  of  patents  and  papers  in  the  late  196C)s  and  early  1970s.  An 
extensive  bibliography  on  magnetic  bubble  technology  compiled  by  Chang  (1975)  of  IBM, 
identifies  201  U.S.  patents  issued  (see  Figure  3.1)  and  1 132  papers  published  between  1969 
and  mid-1974.  Although  a  number  of  industrial  laboratories  became  active  in  the  develop- 
ment of  magnetic  bubbles  during  this  period,  the  two  firms  most  intensively  involved  from 
the  beginning  were  AT&T  and  IBM. 
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Figure  3- 1 :  Cumulative  number  of  U.S.  patents  issued  for  magnetic  bubble  technology. 


Magnetic  bubbles  were  considered  to  be  an  important  mid-range  storage  technology 
that  could  fill  the  niche  between  high-speed,  but  high-priced  semiconductor  memories  and 
low-priced,  but  low-speed  tape  and  disk  memory  devices  (Feth,  1976).  Along  with  magnetic 
bubbles,  there  were  a  number  of  other  "gap-filler"  memory  storage  technologies  under 
development  during  the  1970s,  such  as  charged-couple  devices  and  fixed-head  disks  (see 
Figure  3.2).  Magnetic  bubble  technology  was  considered  an  attractive  alternative  to  existing 
magnetic  disk  and  tape  systems,  in  part,  because  it  gready  reduced  mechanical  movement 
(Mees,  1976). 
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Figure  3.2:  Price/performance  comparison  of  storage  technologies  (Feth,  1976). 


In  the  span  of  a  few  years,  magnetic  bubbles  had  become  touted  in  the  technical 
literature  zs  an  emerging  technology  with  significant  commercial  potential.  Predictions  for 
magnetic  bubbles  in  the  early  1970s  were  uniformly  optimistic.  Bobeck  and  Scovil  (1971) 
believed  that  magnetic-bubble  memories  would  be  "substantially  cheaper  than  core  memo- 
ries and  up  to  10  times  faster  than  magnetic-disk  memory  systems  now  widely  used  for  high 
capacity  storage. "  The  expectations  within  the  research  community  for  magnetic  bubble 
technology  were  echoed  in  a  report  by  the  (U.S.)  National  Academy  of  Sciences  in  1972: 

Magnetic  bubble  technology  offers  a  radical  new  way  to  store  information  in  thin,  transpar- 
ent magnetic  crystaJs  and  to  perform  logical  operations  by  the  controlled  motion  of  mag- 
netic bubbles  over  the  crystal....  Magnetic  bubble  memories  may  replace  both  the  core  and 
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disk  file  memories  in  computers  and  elearonic  central  offices  and  interface  directly  with  fast 
semiconductor  memories.  They  may  prove  to  be  a  very  fast,  compact,  and  inexpensive  way 
to  store  and  process  data. 

By  1976,  it  was  reported  that  some  firms  had  initiated  or  expanded  pilot  production 
lines  and  that  experts  were  confident  that  several  commercial  devices  would  be  introduced 
within  a  year  (Torreno,  1976).  The  enthusiasm  for  magnetic  bubble  technology  was 
attributed  to  a  number  of  factors,  including:  a  decline  in  the  cost  of  wafer  substrates, 
making  it  competitive  with  the  cost  of  silicon  memory  devices;  the  discovery  of  new  bubble 
films  that  could  be  more  readily  grown  on  wafers;  newly  developed  circuit  designs  that 
enabled  the  use  of  standard  semiconductor  manufacturing  equipment  as  well  as  higher 
storage  densities;  and  the  development  of  standard  packages  similar  to  those  used  with 
semiconductor  devices.  A  group  of  leading  magnetic  bubble  researchers  from  AT&T 
assessed  the  future  prospects  of  the  technology  in  the  following  manner: 

One  question  that  can  be  asked  is  "Will  bubbles  survive  the  test  and  join  the  select  winner's 
circle  in  memory  technology?"  The  present  authors,  although  admittedly  strongly  biased, 
believe  they  will  because  they  have  developed  within  a  relatively  short  time  into  an  inte- 
grated memory  technology  of  elegant  simplicity  which  is  now  ready  to  fill  an  existing  gap  in 
the  memory  cost  versus  access  time  spectrum.  Most  importantly,  however,  is  the  future 
growth  capability  of  this  technology  which. ..will,  we  believe,  lead  to  the  ultimate  replace- 
ment for  those  marvelous  mechanical  whirling  dervishes,  the  moving  head  disk  and  tape 
memories.  Deeds  not  words  will  be  the  ultimate  proof  (Bobeck,  Bonyhard  and  Geusic, 
1975). 

This  optimism  was  shared  by  industry  experts  who  anticipated  magnetic  bubble  storage 
densities  to  increase  even  more  rapidly  than  semiconductor  memory  technology.  At  a  time 
when  semiconductor  memory  devices  were  being  produced  with  densities  in  the  range  of  4- 
to  l6-kilobits,  it  was  reported  in  1976  that  one  company  would  begin  shipment  of  100- 
kilobit  bubble  memory  devices  by  early  1977  (Torreno,  1976).  It  was  also  predicted  that  by 
1980,  there  would  be  magnetic  bubble  devices  with  128-kilobit  densities  and  a  40-percent 
decline  in  prices.  In  comparison,  predictions  were  made  for  l6-kilobit  semiconductor 
random-access  memories  and  similar  price  decreases  over  the  same  time  period  (Feth, 
1976). 

Although  the  future  of  magnetic  bubbles  certainly  appeared  bright,  by  the  mid-1970s 
there  were  still  a  number  of  issues  to  resolve  before  the  technology  could  gain  widespread 
acceptance.  As  Cohen  and  Chang  (1975)  stated: 

Great  progress  has  been  made  in  the  development  of  magnetic  bubble  devices  in  the  period 
from  1967....  However,  the  question  of  whether  bubble  memories  will  eventually  be  used 
for  large  capacity  (>10"  bits)  computer  memory  storage  (e.g.,  as  a  replacement  for  magnetic 
disk  files)  is  still  open,  and  depends  on  future  technical  progress. 

The  cautious  tone  of  their  remarks  was  well-founded.  The  high  expectations  most 
experts  held  for  the  commercialization  of  magnetic  bubble  technology  never  fully  material- 
ized. Numerous  technical  problems  that  researchers  sought  to  resolve  proved  more  difficult 
than  initially  estimated.  The  slowing  pace  of  progress  in  magnetic  bubbles  made  them 
increasingly  less  attractive  than  other  memory  storage  technologies.  By  the  early  1980s, 
semiconductor  technologies  at  one  end,  and  disk  technologies  at  the  other  end,  had 
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advanced  at  such  a  rapid  pace  chat  the  once  perceived  "gap"  in  the  storage  technology 
spectrum  had  closed. 

4.  Data 

At  present,  data  that  could  be  readily  used  in  the  hazard  rate  analysis  of  a  newly 
emerging  technology  are  rarely  collected  in  a  comprehensive  and  systematic  fashion.  This  is 
understandable,  since  data  on  the  duration  of  commitment  by  individual  researchers  to  the 
development  of  a  technology  would  require  a  fair  amount  of  effort  to  collect  and  maintain 
on  a  continuous  basis  over  a  large  number  of  years.  Although  data  may  exist  in  the  archives 
of  government  funding  agencies  and  industrial  firms,  the  population  of  researchers  actively 
working  on  a  given  technology  is  typically  sufficiently  large  and  widely  dispersed  to  make 
country-by-country,  and  firm-by-firm  data  collection  impractical. 

In  the  future,  duration  data  may  become  part  of  the  normal  data  collection  activities  of 
government  science  and  technology  agencies.  Until  then,  we  can  use  a  proxy  for  individual 
duration  data:  namely,  data  on  the  span  of  author  contributions  to  the  scientific  and  techni- 
cal literature.  Publications  in  a  field  represent  a  fairly  well  detailed,  self-reported  archival 
record  generated  by  researchers  in  their  efixjrt  to  solve  the  scientific  and  technical  problems 
confronting  them.  As  a  source  of  data,  clearly  it  would  be  very  difFicult  to  match  the  com- 
prehensive scope  and  longitudinal  nature  of  the  literature  using  other  data  collection 
techniques.  When  taken  together,  the  literature  can  be  viewed  as  a  unique  chronology  of  the 
global  efforts  of  researchers  to  establish  a  new  field,  and  can  be  used  to  determine  the  persis- 
tence of  researchers  through  an  examination  of  their  "contribution-spans":  i.e.,  the  time 
span  between  a  researcher's  first  and  last  known  contribution  to  the  literature  in  a  field. 

Although  data  extracted  from  the  literature  will  reflect  the  idiosyncrasies  of  publication 
behavior  to  some  degree,  the  measurement  of  contribution-spans  is  relatively  unaffected  by 
publication  frequency.  Researchers  simply  must  publish  at  least  periodically  in  order  to 
establish  a  span  of  their  activity.  In  this  manner  contribution-span  data  can  provide  us  with 
an  approximation  of  researchers'  persistence  in  a  field.  Clearly,  in  the  absence  of  more 
precise  data,  the  literature  is  a  valuable  source  of  information  about  the  level  of  activity  and 
rate  of  progress  in  a  field.  Indeed,  it  is  not  unusual  for  researchers  themselves  to  see  a  con- 
nection between  the  literature  and  progress  in  their  field.  For  example,  early  in  the 
emergence  of  magnetic  bubble  technology,  Bobeck,  et  al.  (1971)  state:  "It  is  evident  from 
the  number  of  papers  concerning  all  aspects  of  magnetic  bubbles  technology  that  have 
appeared  in  the  last  year  that  the  rate  of  progress  in  this  comparatively  new  field  has 
remained  at  a  high  level." 

A  commercially  available  electronic  database  (INSPEC)  covering  the  science  and  engi- 
neering literature  was  used  to  identify  publications  in  the  field  of  magnetic  bubble  memory 
devices.  The  database  was  searched  on-line  using  a  set  of  key  terms  that  were  known  to  be 
commonly  used  in  the  lexicon  of  magnetic  bubbles  researchers  and  might  be  either  in  the 
tide,  abstract,  or  classification  terms  of  a  document.  The  computer  search  identified  over 
two-thousand  documents.  The  documents  were  retrieved  electronically  and  temporarily 
placed  in  a  bibliographic  database  operating  on  a  personal  computer.  Each  document  was 
carefully  inspected  in  order  to  ensure  the  accuracy  and  integrity  of  the  search  procedure. 
Documents  that  did  not  pertain  to  magnetic  bubbles  or  were  not  research-oriented 
contributions  were  discarded.  After  inspection,  the  database  consisted  of  a  total  of  2025 
documents. 
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The  documents  were  first  edited  to  ensure  consistency  among  author  and  affiliation 
names.  The  edited  database  was  then  used  to  identify  1734  individuals  who  contributed  to 
the  field  over  two  decades,  from  1969  to  1988.  A  statistical  database  was  created  consisting 
of  each  researcher,  the  years  they  were  active  in  the  field,  and  the  length  of  their 
contribution-span.  The  contribution-span  is  calculated  as  the  number  of  years  that  have 
elapsed  from  the  first  to  the  last  known  publication  for  each  author.  Authors  who  publish  in 
only  one  year  are  given  a  contribution-span  of  one  year. 

The  calculation  of  contribution-spans  is  fairly  straightforward.  Nonetheless,  since 
authors  do  not  always  publish  in  consecutive  years,  some  judgment  is  necessary  to  deter- 
mine when  an  individual  is  likely  to  have  ceased  active  research  in  the  field.  Previous 
analysis  of  the  frequency  of  yearly  gaps  between  publications  for  authors  with  contribution- 
spans  of  more  than  one  year  indicates  that  the  time  elapsed  without  publication  is  usually 
no  more  than  three  years  (Rappa  and  Garud,  1992).  Thus,  for  analytical  purposes,  all 
contribution-spans  with  gaps  of  no  more  than  three-years  are  treated  as  a  contiguous  span. 
In  cases  where  there  was  a  publication  gap  longer  than  three-years,  the  author  is  considered 
to  have  exited  and  then  subsequently  re-entered  the  field. 

5.  Results 

An  analysis  of  author  contribution  spans  in  the  development  of  magnetic  bubbles  shows 
the  rapid  growth  and  decline  of  activity  in  the  field.  Figure  5.1  indicates  the  rise  in  partici- 
pation between  1969  and  1976,  when  the  field  peaked  with  426  individuals  active. 
Subsequent  to  1976,  the  level  of  participation  began  to  decline — remarkably  so  after 
1979 — such  that  by  1988  there  were  just  a  few  dozen  authors  still  contributing  to  the  field. 
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Figure  51:  Growth  of  the  magnetic  bubble  research  community,  1969-88. 


About  two-thirds  of  the  authors  in  the  database  are  industrial  researchers.  Authors  affil- 
iated with  U.S.  organizations  constitute  slightly  more  than  half  of  total  population.  The 
other  most  represented  countries  are  Japan  (19.7%),  Great  Britain  (8.0%),  the  former 
U.S.S.R.  (5.4%),  and  France  (2.6%).  Most  authors  (63. 5%)  are  transient,  with  contribu- 
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cion-spans  of  only  one  year.  About  10%  have  contribution-spans  of  more  than  five  years 
and  2.5%  have  spans  of  more  than  ten  years.  The  longest  contribution-span  is  seventeen 
years.  The  mean  number  of  authorships  in  a  single  year  is  1.1  (s.d.=  1.0),  and  the  largest 
number  is  12.  The  mean  number  of  publications  over  an  entire  contribution  span  is  3.9 
(s.d.  =  5.4),  though  57%  of  all  authors  having  just  one  publication  in  the  field.  The  largest 
number  of  authorships  by  a  single  individual  is  57.  The  largest  number  of  authors  affiliated 
with  an  organization  is  117. 

The  first  step  in  the  analysis  was  to  make  a  non-parametric  estimate  of  the  survival 
function  for  each  year  from  1974  to  1985.  The  calculations  were  made  using  the  lifetable 
approach.  The  results  are  illustrated  in  Figure  5.2.  To  simplify  the  graphics,  the  years  1974 
and  1978  were  selected  as  representative  of  the  situation  before  and  after  the  peak  year, 
1976.  The  survival  functions  are  shown  in  diagram  (a).  A  clear  shift  upward  of  the  survival 
curve  occurred  between  1974  and  1978,  indicating  an  increase  in  the  probability  of 
researchers  suying  in  the  field.  In  1974  the  probability  of  staying  in  the  field  for  five  years 
was  approximately  .50.  This  compares  with  a  probability  of  about  .75  in  1978.  This  con- 
trasts with  the  change  in  the  survival  curve  after  1978  is  illiistrated  in  diagram  (b).  The 
survival  curve  shifted  downward  such  that  the  likelihood  of  contributing  to  the  field  for  five 
years  declined  from  .75  in  1978  to  about  .53  in  1982. 
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Figure  5-2:  Changes  in  the  survival  function  of  the  magnetic  bubble  community  fi'om  (a)  1974 
and  1978  and  (b)  1978  and  1982. 

Non-parametric  estimates  of  the  hazard  functions  were  also  calculated  using  the  lifetable 
approach.  The  results  are  illustrated  in  Figure  53.  The  hazard  functions  for  1974  and  1978 
are  shown  in  diagram  (a).  Over  the  five-year  period  the  hazard  function  generally  shifted 
downward.  The  probability  of  authors  ceasing  to  contribute  to  the  field  in  1974,  after 
having  been  in  the  field  for  five  years,  was  approximately  .36.  This  compares  with  a  condi- 
tional probability  of  about  .  1  1  in  1978.  The  hazard  rate  for  authors  with  one-year  con- 
tribution-spans also  declined  substantially,  from  about  .34  in  1974  to  less  than  .19  in  1978. 
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The  change  in  the  hazard  rate  between  1978  and  1982  is  illustrated  in  diagram  (b)  of 
Figure  5.3.  In  the  five  years  subsequent  to  1978,  the  hazard  function  shifted  upward  for 
authors  with  one-year  contribution-spans,  but  generally  shifted  downward  for  authors  with 
spans  longer  than  five  years.  The  likelihood  of  exiting  after  a  one-year  contribution-span 
more  than  doubled  from  .19  in  1978  to  .41  in  1982.  However,  the  hazard  rate  for  authors 
with  five-year  spans  is  unchanged.  What  is  curious  are  the  high  hazard  rates  in  1982  for 
authors  with  contribution  spans  of  12-13  years.  This  may  be  caused  the  retirement  of  more 
senior  researchers  in  the  field,  but  this  is  not  necessarily  the  case.  Prior  hazard  rate  studies  of 
other  fields  do  not  support  this  explanation  (e.g.,  Rappa  and  Garud,  1992;  Rappa, 
Debackere  and  Garud,  1992). 
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Figure  5.3:  Changes  in  the  hazard  function  of  the  magnetic  bubble  community  from  (a)  1974 
and  1 978  and  (b)  1 978  and  1 982. 


The  change  m  the  hazard  rate  over  time  for  one-year  and  five-year  contribution-spans 
{d=\  and  d=5)  were  calculated  for  the  period  from  1974  to  1985  (see  Figure  5.4).  In  the 
case  of  authors  with  one-year  contribution  spans,  the  hazard  rate  varies  greatly  over  time. 
Initially  it  declines  from  about  .35  in  1974-76  to  about  .20  in  1977-78.  After  1977  the 
hazard  rate  increases  dramatically  from  .20  to  .50  in  1981.  Interestingly,  the  rate  decreases 
again  to  a  low  of  about  .25  in  1983,  before  rising  again  to  near  .50  in  1985.  Generally 
speaking,  the  hazard  rate  is  higher  in  the  post- 1978  period.  In  the  case  of  authors  with  five- 
year  contribution-spans,  the  hazard  rate  declined  rapidly  from  over  .35  in  1974  to  about  .15 
in  1975,  to  a  low  of  about  .04  in  1977.  After  1977,  the  hazard  rate  remained  fairly  stable 
from  .04  to  .1  through  1985. 


6.  D 


iscussion 


Today,  the  assessment  of  emerging  technologies  is  frequently  a  matter  of  sorting-out 
expert  judgment.  Technical  and  market  experts  are  asked  to  provide  their  best  sense  of 
significant  future  trends  they  anticipate  will  emerge.   However,  soliciting  sound  expert 
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Figure  5-4:      Hazard  rate  changes  from  1974  and  1985  for  authors  with  one-year  and  five-year 
contribution-spans. 

judgment  is  no  simple  matter.  A  number  of  problems  can  arise  in  the  interaction  between 
experts  and  managers,  and  among  experts  themselves,  that  can  affect  the  accuracy  of  the 
judgments  they  make. 

Several  techniques  have  been  developed  to  mitigate  the  element  of  bias  inherent  in  the 
solicitation  of  expert  opinion  (Kahneman,  Slovic  and  Tversky,  1982;  Armstrong,  1985; 
Cooke,  1991;  Porter,  et  al.,  1992).  Nonetheless,  a  dilemma  remains  in  the  expert  appraisal 
of  emerging  technologies.  Experts  who  are  the  most  knowledgeable  about  a  technology — 
because  they  are  involved  in  its  development — are  more  likely  to  make  optimistic  predic- 
tions about  its  progress  toward  commercialization.  This  is  due,  in  part,  to  the  difficulty  such 
experts  have  in  separating  what  they  want  to  happen  from  what  they  think  will  happen. 

However,  to  resort  to  experts  who  are  less  knowledgeable  about  the  technology — 
because  they  have  little  actual  experience  with  its  development — does  little  to  resolve  the 
problem.  Not  only  might  they  simply  not  know  enough  to  make  accurate  judgments,  they 
may  also  have  their  own  commitments  to  alternative  technologies  that  blind  them  from 
seeing  the  benefits  of  the  technology  they  are  asked  to  appraise.  Much  of  the  technical  de- 
bate that  surrounds  an  emerging  technology  is  embedded  in  the  conflict  which  arises  among 
those  experts  who  have  a  vested  interest  in  seeing  it  develop,  and  those  experts  who  have  a 
vested  interest  that  is  diametrically  opposed. 

Theoretically  speaking,  the  emergence  of  a  new  technology  should  not  be  as  difTicult  to 
comprehend  as  it  sometimes  appears.  The  technologies  that  will  be  of  the  most  significance 
five-to-ten  years  from  now  already  exist  in  research  laboratories,  albeit  in  a  primitive  form. 
Technologies  do  not  emerge  instantaneously  from  idea  to  commercial  application — regard- 
less of  the  impression  publicists  may  create.  Typically,  several  years,  if  not  several  decades, 
may  intervene  prior  to  widespread  commercial  use.  Technological  development  is  a  slow 
process  of  learning  what  will  work — and  what  will  not.  At  any  given  moment,  some  tech- 
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nologies  will  be  increasing  in  their  momentum  toward  commercial  application,  while  other 
(perhaps  once  very  promising)  technologies  are  decreasing  in  their  momentum.  One  of  the 
principle  challenges  in  assessing  emerging  technologies  is  to  accurately  ascertain,  on  a  global 
scale,  changes  in  a  technology's  rate  of  progress  toward  commercial  application. 

We  will  never  do  away  with  experts  and  their  judgments  about  technology.  Beyond  how 
we  select  experts  and  solicit  their  opinions,  the  critical  question  is  whether  or  not  we  can 
improve  upon  the  information  available  to  managers  (and  experts)  when  formulating  judg- 
ments in  technology  assessment.  In  this  regard,  hazard  models  may  shed  additional  light  on 
the  relative  rate  of  global  progress  in  the  emergence  of  new  technologies.  In  essence,  the 
survival  and  hazard  functions  for  a  field  represent  the  aggregate  judgments  of  all  the  experts, 
researchers,  managers,  and  others  who  may  have  a  stake  in  the  technology's  development. 

The  results  of  the  present  empirical  analysis,  which  uses  contribution-spans  as  a  surro- 
gate measure  for  researcher  durations  in  the  field  of  magnetic  bubble  technology,  are 
suggestive.  In  the  case  of  the  survival  function,  there  appears  to  be  a  general  concurrence 
with  theoretical  expectations  of  how  it  should  shift  over  time.  The  survival  function  shifted 
upward  as  the  field  expanded  and  enthusiasm  grew.  After  1978,  however,  the  function 
shifted  downward,  reflecting  the  diminished  interest  in  the  field. 

The  evidence  from  the  hazard  rate  analysis  is  less  clear.  Although  the  hazard  rate  did 
decline  substantially  for  authors  with  one-year  and  five-year  contribution-spans  prior  to 
1978,  after  1978  it  was  only  in  the  case  of  authors  with  one-year  contribution-spans  that 
the  hazard  rate  subsequently  increased.  This  finding  is  suggestive  of  the  significant  influence 
that  accumulated  experience  in  field  can  have  on  individuals  in  reducing  the  likelihood  of 
their  exit  from  a  field. 

The  empirical  findings  must  be  interpreted  in  light  of  the  inadequacies  of  scientific  and 
technical  literature.  The  omission  of  researchers  who  are  either  unwilling,  uninterested  or 
unable  to  publish  or  present  their  research  is  clearly  one  limitation.  While  the  analysis  is 
relatively  insensitive  to  a  researcher's  publicauon  frequency  beyond  some  minimal  level  to 
establish  the  contribution  span,  it  cannot  account  for  only  those  individuals  who  do  not 
contribute  to  the  literature.  Ideally,  duration  data  collected  on  a  regular  and  comprehensive 
basis  would  be  the  most  useful  for  such  an  analysis.  Government  and  industry  should  seri- 
ously examine  the  potential  usefulness  of  hazard  rate  models,  and  the  possibility  of 
collecting  duration  data  for  critical  pre-commercial  technologies  as  part  of  the  on-going 
activities  to  construct  and  disseminate  science  and  technology  indicators. 
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Appendix 

Formally,  the  survival  and  hazard  functions,  and  the  associated  probability  distribution, 
are  derived  as  follows  (Yamaguchi,  1991):  Let  7"  be  a  random  variable  for  the  duration  of 
the  risk  period  for  an  event  (e.g.,  exit  from  the  field).  Then  the  hazard  rate  h(f)  is  given  as 


h(r)  =  lim 


P([  +  M>T>t  I  T>t)_  f(0 
It  ~S(0 


where  P{t  +  At  >  T  >  t  \  T  >  t)  indicates  the  probability  that  the  event  occurs  during  the 
time  (t,  t  +  Af)  given  chat  the  event  did  not  occur  prior  to  time  t.  The  survivor  function  S(0 
is  given  as: 


S(0  =  ?{T  >t)  =  exp 
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The  unconditional  instantaneous  probability  of  having  an  event  at  time  t,  f(t),  which  is  also 
called  the  probability  density  function  ofT,  is  given  as: 
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